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Abstract 

Wc consider a problem of optimizing convex functionals over matroid bases. It is richly ex- 
pressive and captures certain quadratic assignment and clustering problems. While generally 
NP-hard, we show it is polynomial time solvable when a suitable parameter is restricted. 



1 Introduction 

Let M = (N,B) be a matroid over N := {l,...,n} with collection of bases B C 2^. Let 
w : N — ► M. d be a weighting of matroid elements by vectors in d-space. For any subset J Q N 
let w(J) := Y2jej w U) with w(<f) := 0. Finally, let c : M. d — > K be a convex functional on M. d . 
We consider the following algorithmic problem. 

Convex matroid optimization. Given data as above, find a basis B € B maximizing c(w{B)). 

We begin with some examples of specializations of this problem. 

Example 1.1 Linear matroid optimization. This is the special case of our problem with 
d = 1, w : N — > K a weighting of elements by scalars, and c : R — > R : x i— > x the identity. The 
problem is to find a basis of maximum weight, and is quickly solvable by the greedy algorithm. 



Example 1.2 Positive semidefinite quadratic assignment. This is the NP-hard problem 
H of finding a vector x G {0, l} n maximizing ||Wx|| 2 = x T W T Wx with a given d x n matrix. 
For fixed d it is solvable in polynomial time Q. The variant of this problem in which one asks 
for x with restricted support |supp(x)| = r is the special case of our problem with M := the 
uniform matroid of rank r over N, with w(j) := W J the jth column of W for all j € JV, and 
with c : — > Kim ||^|| 2 the ^-norm (squared or not). The positive semidefinite quadratic 
assignment problem can be solved by solving the variant for r = 0, . . . , n and picking the best x. 
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Example 1.3 Balanced clustering. This is the problem of partitioning a given set {w i, . . . , w n } 

of points in M. d into two clusters C\, C2 of equal size m := so as to minimize the sum of cluster 
variances given by 

^ E 5>i)H a + ^ E E -i)H 2 - 

It can be shown by suitable manipulation of the variance expression that this is the special case 
of our problem with M the uniform matroid of rank ~ over N, with w(j) := Wj for all j € N, 
and with c : M, d — > 8:11-4 \\x\\ 2 + [ |it?(iV) — x\\ 2 with w(N) = X^j=i w i ^ ne sum °f an points- 

While the linear matroid optimization problem (Example is greedily solvable (cf . Q ) , the 
general convex matroid optimization problem is NP-hard as indicated by Example |l,2j . Neverthe- 
less, in this article we show that, so long as d is fixed, the problem can be solved in polynomial 
time for an arbitrary matroid M and an arbitrary convex functional c. We assume that c is 
presented by an evaluation oracle that given x 6 M. d returns c(x), and that M is presented by an 
independence oracle that given J Q N asserts whether or not J is an independent set of M. In 
this article we establish the following theorem. 

Theorem 1.4 For any fixed d, the convex matroid optimization problem with oracle presented 
matroid M over N := {1, . . . , n}, weighting w : N — > M. d , and oracle presented convex functional 
c : M d — ► M, can be solved in polynomial oracle time using 0(n 2d_1 logn) operations and queries. 

The computational complexity is measured in terms of the number of real arithmetic operations 
and oracle queries. For rational input the algorithm is (strongly) polynomial time in the Turing 
computation model where the input includes the binary encoding of the weighting w : N — * Q d 
and the binary encoding of an upper bound U := max jcn c(w(J)) on the relevant values of the 
convex functional, but we do not dwell on the details here. 

The special case of the convex matroid optimization problem for uniform matroids coincides 
with the special case of the so-called shaped partition problem @ for two parts. Therefore, the 
specializations to two-parts of the lower bounds of p], imply a lower bound of r2(re d_1 ) on 
the complexity of the convex matroid optimization problem. It would be very interesting to 
further study a plausible common generalization of the convex matroid optimization problem for 
arbitrary matroids and the shaped partition problem for arbitrary number of parts. 

2 Proof of the theorem 

For a matroid M = (N, B) and a weighting w : N — > M. d , consider the following convex polytope 

V% := conw{w{B) : B € B) C R d . 

The convex matroid problem can be reduced to maximizing the convex functional c over V^ 1 : 
there will always be an optimal basis B € B for which w(B) is a vertex of V^f and so the 
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problem can be solved by picking the best such vertex. However, as the number of matroid bases 
is typically exponential in n it is not possible to construct V^f directly in polynomial time. To 
overcome this we consider the following zonotope: 

V w := [-1,1] -(w(i)-w(j)) C R d . 

l<i<j<n 

Proposition 2.1 Fix any d. Then the number of vertices of the zonotope V w is 0(n 2 ( d ~ 1 ^ ). 
Further, in polynomial time using that many arithmetic operations, all its vertices can be listed, 
each vertex v along with a linear functional a(v) G M. d uniquely maximized over V w at v. 

Proof. The zonotope V w is the Minkowski sum of m := line segments in M. d and therefore 
(cf. H |) has 0(m d - 1 ) = 0(n 2 ( d-1 )) vertices which can all be enumerated, each v along with a 
vector a(v) uniquely maximized at v, using that many arithmetic operations. □ 

Let V M := conv{l b '■ B G B} C M. n be the basis polytope of the matroid M = (N, B), where 
1b '■= YljeB e j ^ s the incidence vector of B G B with ej the jth standard unit vector in R n . We 
include the short proof of the following statement. 

Proposition 2.2 Every edge of the basis polytope is equal to ej — e,- for some pair i,j G N . 

Proof. Consider any pair A, B G B of bases such that [1a, 1b] is an edge (that is, a 1-face) 
of V M , and let a G M n be a linear functional uniquely maximized over V M at that edge. If 
A \ B = {i} is a singleton then B \ A = {j} is a singleton as well in which case 1a — 1b = &i — ej 
and we are done. Suppose then, indirectly, that it is not, and pick an element i in the sym- 
metric difference AAB := (A \ B) U (B \ A) of A and B of minimum value aj. Without loss 
of generality assume i G A \ B. Then there is a j G B \ A such that C := A \ {i} U {j} is 
a basis of M. Since |j4AS| > 2, C is neither A nor B. By the choice of i, this basis satisfies 
a ■ 1q = a ■ 1a — o>i + cij > a • 1a, an d hence lc is also a maximizer of a over V M so lies in the 
1-face [1a, 1 b]- But no {0, 1}- vector is a convex combination of others, yielding a contradiction. □ 

The normal cone of a face at a polyhedron P in M. d is the relatively open cone of those linear 
functionals a G M. d uniquely maximized over P at that face. The collection of normal cones of all 
faces of P is called the normal fan of P. A polyhedron P is a refinement of a polyhedron Q if 
the normal fan of P is a refinement of that of Q, that is, the closure of each normal cone of Q is 
the union of closures of normal cones of P. We have the following lemma. 

Lemma 2.3 The zonotope V w is a refinement of the polytope V^f ■ 

Proof. Let it : W 1 — ► M. d : ej i— > w(j) be the natural projection sending the unit vector ej 
corresponding to the matroid element j G N to the vector w(j) G M. d . Then for each B G B we 
have 7t(1b) = w(B) and hence 



V™ = conv{w{B) : BeB} = conv{vr(l B ) : B £ B} = tt(V m ) 
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so V^f is a projection of V M . Thus, each edge of V^f is the projection of some edge of V M and 
hence, by Proposition 2.2 , is equal to 7r(ej — e^) = w(i) — w(J) for some pair i, j E N. Thus, the 
zonotope V w = Yli<i<j< n [~ 1> 1] ' ( w (^) ~ W U)) * s the Minkowski sum of a set of segments contain- 
ing all edge directions of V^f and hence its normal fan is a refinement of the nor malfanofP* f . □ 



We are now in position to prove our theorem. 



Proof of Theorem 1.4- Given data M,w,c, the algorithm proceeds with the following steps: 



first, compute via Proposition 2.1 the list of 0{n 2<yd ^ ) vertices v of V w , each v along with a 



linear functional a(v) G R uniquely maximized over V w at v. Second, for each v do the following: 
let a := a(v) and define the following weighting of matroid elements by scalars: 

d 

b: M — > R : j ^ a ■ w(j) = ^ aiw(j)i ; 

i=l 

now apply a greedy algorithm to obtain a basis B(v) € B of maximum weight b(B), that is, 
sort N by decreasing b- value (using 0(n log n) operations) and find, using at most n calls to 
the independence oracle presenting M, the lexicographically first basis B(v). Third, for each v 
compute the value c(w(B(v))) using the evaluation oracle presenting c; an optimal basis for the 
convex matroid optimization problem is any B(v) achieving maximal such value among the bases 
B{y) of vertices v of V w . The complexity is dominated by the second step which takes 0{n log n) 
operations and queries and is repeated 0{n 2<yd ~ 1 ^ ) times, giving the claimed bound. 

We now justify the algorithm. First, we claim that each vertex u of V^f satisfies u = w(B(v)) 
for some B(v) produced in the second step of the algorithm. Consider any such vertex u. Since 
V w refines V^f by Lemma |2.3| , the normal cone of u at V^f contains the normal cone of some 
(possibly more than one) vertex v of V w . Then a := a(v) is uniquely maximized over u. 
Now, consider the second step of the algorithm applied to v and let b be the corresponding scalar 
weighting of matroid elements. Then the b- weight of any basis B satisfies 

b(B) = a ■ w(j) = a ■ w(j) = a-w(B) < a-u 

with equality if and only if w(B) = u. Thus, the maximum 6-weight basis B(v) produced by the 
greedy algorithm will satisfy u = w(B(v)). Thus, as claimed, each vertex u of V^ 1 is obtained as 
u = w{B(v)) for some B(v). 

Now, since c is convex, the maximum value c(w(B)) of any basis B € B will occur at some 
vertex u = w(B(v)) of V,^f = couv{ w(B) : B £ B}. Therefore, any basis B(y) with maximum 
value c(w(B(v))) is an optimal solution to the convex matroid optimization problem. The third 
step of the algorithm produces such a basis and so the algorithm is justified. □ 



References 



Shmuel Onn 



5 



[1] N. Alon and S. Onn, Separable partitions, Discrete Applied Mathematics, 91:39-51, 1999. 

[2] S. Aviran and S. Onn, Momentopes and the vertex complexity of partition polytopes, Dis- 
crete and Computational Geometry, 27:409-417, 2002. 

[3] K. Allemand, K. Fukuda, T.M. Liebling and E. Steiner, A polynomial case of unconstrained 
zer-one quadratic optimization, Mathematical Programming Series A, 91:49-52, 2001. 

[4] W.J. Cook, W.H. Cunningham, W.R. Pulleyblank and A. Schrijver, Combinatorial Opti- 
mization, John Wiley & Sons, 1997. 

[5] P. Gritzmann and B. Sturmfels, Minkowski addition of polytopes: complexity and applica- 
tions to Grobner bases, SIAM Journal on Discrete Mathematics, 6:246-269, 1993. 

[6] L.P. Hammer, P. Hansen, P.M. Pardalos and D.J. Rader, Maximizing the product of two 
linear functions in — 1 variables, RUTCOR Research Report, Rutgers University, 1997. 

[7] F.K. Hwang, S. Onn and U.G. Rothblum, A polynomial time algorithm for shaped partition 
problems, SIAM Journal on Optimization, 10:70-81, 1999. 

[8] S. Onn and L.J. Schulman, The vector partition problem for convex objective functions, 
Mathematics of Operations Research, 26:583-590, 2001. 



Shmuel Onn 

Technion - Israel Institute of Technology, 32000 Haifa, Israel, 
and 

University of California at Davis, Davis, CA 95616, USA. 
email: onn@ie.technion.ac.il, onn@math.ucdavis.edu, 
http://ie. technion. ac. il/~ onn 



